<!DOCTYPE html>
<html class="client-nojs vector-feature-night-mode-disabled vector-feature-language-in-header-enabled vector-feature-language-in-main-page-header-disabled vector-feature-page-tools-pinned-disabled vector-feature-toc-pinned-clientpref-1 vector-feature-main-menu-pinned-disabled vector-feature-limited-width-clientpref-1 vector-feature-limited-width-content-enabled vector-feature-custom-font-size-clientpref-1 vector-feature-appearance-pinned-clientpref-1 vector-sticky-header-enabled" lang="en" dir="ltr"><head>
<meta charset="UTF-8">
<title>DeepSpeed</title>
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<link rel="canonical" href="https://en.wikipedia.org/wiki/DeepSpeed"> <link href="./mw/ext.cite.styles.css" rel="stylesheet" type="text/css">
<link href="./mw/skins.vector.icons.css" rel="stylesheet" type="text/css">
<link href="./mw/skins.vector.search.codex.styles.css" rel="stylesheet" type="text/css">
<link href="./mw/skins.vector.styles.css" rel="stylesheet" type="text/css">
<link href="./mw/user.styles.css" rel="stylesheet" type="text/css">
<meta name="ResourceLoaderDynamicStyles" content="">
<link rel="stylesheet" type="text/css" href="./mw/site.styles.css">
<link rel="stylesheet" type="text/css" href="./mw/noscript.css">
<link rel="stylesheet" type="text/css" href="./footer.css">
<link rel="stylesheet" type="text/css" href="./vector-2022.css">
</head>
<body class="skin--responsive skin-vector skin-vector-search-vue mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-0 ns-subject page-DeepSpeed rootpage-DeepSpeed skin-vector-2022 action-view">
<div class="mw-page-container">
<div class="mw-page-container-inner">
<div class="mw-content-container">
<main id="content" class="mw-body">
<header class="mw-body-header vector-page-titlebar">
<h1 id="firstHeading" class="firstHeading mw-first-heading">
<span id="openzim-page-title" class="mw-page-title-main"><span class="mw-page-title-main">DeepSpeed</span></span>
</h1>
</header>
<a id="top"></a>
<div id="bodyContent" class="vector-body ve-init-mw-desktopArticleTarget-targetContainer" aria-labelledby="firstHeading" data-mw-ve-target-container="">
<div id="mw-content-text" class="mw-body-content mw-content-ltr" lang="en" dir="ltr"><div class="mw-content-ltr mw-parser-output" lang="en" dir="ltr">
<style data-mw-deduplicate="TemplateStyles:r1295905060">
/* start https://en.wikipedia.org/ */
.mw-parser-output .infobox-subbox{padding:0;border:none;margin:-3px;width:auto;min-width:100%;font-size:100%;clear:none;float:none;background-color:transparent}.mw-parser-output .infobox-3cols-child{margin:auto}.mw-parser-output .infobox .navbar{font-size:100%}@media screen{html.skin-theme-clientpref-night .mw-parser-output .infobox-full-data:not(.notheme)>div:not(.notheme)[style]{background:#1f1f23!important;color:#f8f9fa}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .infobox-full-data:not(.notheme)>div:not(.notheme)[style]{background:#1f1f23!important;color:#f8f9fa}}@media(min-width:640px){body.skin--responsive .mw-parser-output .infobox-table{display:table!important}body.skin--responsive .mw-parser-output .infobox-table>caption{display:table-caption!important}body.skin--responsive .mw-parser-output .infobox-table>tbody{display:table-row-group}body.skin--responsive .mw-parser-output .infobox-table th,body.skin--responsive .mw-parser-output .infobox-table td{padding-left:inherit;padding-right:inherit}}
/* end https://en.wikipedia.org/ */
</style><table class="infobox vevent"><tbody><tr><th colspan="2" class="infobox-above summary">DeepSpeed</th></tr><tr><td colspan="2" class="infobox-image logo"></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Programmer" title="Programmer">Original author(s)</a></th><td class="infobox-data"><a href="Microsoft_Research" title="Microsoft Research">Microsoft Research</a></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Programmer" title="Programmer">Developer(s)</a></th><td class="infobox-data"><a href="Microsoft" title="Microsoft">Microsoft</a></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;">Initial release</th><td class="infobox-data">May 18, 2020<span style="display:none"> (<span class="bday dtstart published updated">2020-05-18</span>)</span></td></tr><tr style="display: none;"><td colspan="2" class="infobox-full-data"></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Software_release_life_cycle" title="Software release life cycle">Stable release</a></th><td class="infobox-data"><div style="margin:0px;">v0.16.5
/ March 27, 2025<span style="display:none"> (<span class="bday dtstart published updated">2025-03-27</span>)</span></div></td></tr><tr style="display:none"><td colspan="2">
</td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Repository_(version_control)" title="Repository (version control)">Repository</a></th><td class="infobox-data"><span class="url"><a rel="nofollow" class="external text" href="https://github.com/microsoft/DeepSpeed">github<wbr>.com<wbr>/microsoft<wbr>/DeepSpeed</a></span></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;">Written in</th><td class="infobox-data"><a href="Python_(programming_language)" title="Python (programming language)">Python</a>, <a href="CUDA" title="CUDA">CUDA</a>, <a href="C%2B%2B" title="C++">C++</a></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Software_categories#Categorization_approaches" title="Software categories">Type</a></th><td class="infobox-data"><a href="Software_library" class="mw-redirect" title="Software library">Software library</a></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Software_license" title="Software license">License</a></th><td class="infobox-data"><a href="Apache_License_2.0" class="mw-redirect" title="Apache License 2.0">Apache License 2.0</a></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;">Website</th><td class="infobox-data"><span class="url"><a rel="nofollow" class="external text" href="http://deepspeed.ai">deepspeed<wbr>.ai</a></span></td></tr></tbody></table>
<p><b>DeepSpeed</b> is an <a href="Open_source" title="Open source">open source</a> <a href="Deep_learning" title="Deep learning">deep learning</a> optimization library for <a href="PyTorch" title="PyTorch">PyTorch</a>.<sup id="cite_ref-1" class="reference"><a href="#cite_note-1"><span class="cite-bracket">[</span>1<span class="cite-bracket">]</span></a></sup>
</p>
<meta property="mw:PageProp/toc">
<div class="mw-heading mw-heading2"><h2 id="Library">Library</h2></div>
<p>The library is designed to reduce computing power and <a href="Memory_usage" class="mw-redirect" title="Memory usage">memory use</a> and to train large <a href="Distributed_computing" title="Distributed computing">distributed</a> models with better <a href="Parallel_computing" title="Parallel computing">parallelism</a> on existing <a href="Computer_hardware" title="Computer hardware">computer hardware</a>.<sup id="cite_ref-2" class="reference"><a href="#cite_note-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-3" class="reference"><a href="#cite_note-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup> DeepSpeed is optimized for low latency, high throughput training. It includes the Zero Redundancy Optimizer (ZeRO) for training models with 1 trillion or more parameters.<sup id="cite_ref-4" class="reference"><a href="#cite_note-4"><span class="cite-bracket">[</span>4<span class="cite-bracket">]</span></a></sup> Features include mixed precision training, single-GPU, multi-GPU, and multi-node training as well as custom model parallelism. The DeepSpeed source code is licensed under <a href="MIT_License" title="MIT License">MIT License</a> and available on <a href="GitHub" title="GitHub">GitHub</a>.<sup id="cite_ref-5" class="reference"><a href="#cite_note-5"><span class="cite-bracket">[</span>5<span class="cite-bracket">]</span></a></sup>
</p><p>The team claimed to achieve up to a 6.2x throughput improvement, 2.8x faster convergence, and 4.6x less communication.<sup id="cite_ref-:0_6-0" class="reference"><a href="#cite_note-:0-6"><span class="cite-bracket">[</span>6<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="See_also">See also</h2></div>
<style data-mw-deduplicate="TemplateStyles:r1266661725">
/* start https://en.wikipedia.org/ */
.mw-parser-output .portalbox{padding:0;margin:0.5em 0;display:table;box-sizing:border-box;max-width:175px;list-style:none}.mw-parser-output .portalborder{border:1px solid var(--border-color-base,#a2a9b1);padding:0.1em;background:var(--background-color-neutral-subtle,#f8f9fa)}.mw-parser-output .portalbox-entry{display:table-row;font-size:85%;line-height:110%;height:1.9em;font-style:italic;font-weight:bold}.mw-parser-output .portalbox-image{display:table-cell;padding:0.2em;vertical-align:middle;text-align:center}.mw-parser-output .portalbox-link{display:table-cell;padding:0.2em 0.2em 0.2em 0.3em;vertical-align:middle}@media(min-width:720px){.mw-parser-output .portalleft{margin:0.5em 1em 0.5em 0}.mw-parser-output .portalright{clear:right;float:right;margin:0.5em 0 0.5em 1em}}
/* end https://en.wikipedia.org/ */
</style>
<ul><li><a href="Comparison_of_deep_learning_software" title="Comparison of deep learning software">Comparison of deep learning software</a></li>
<li><a href="Deep_learning" title="Deep learning">Deep learning</a></li>
<li><a href="Machine_learning" title="Machine learning">Machine learning</a></li>
<li><a href="TensorFlow" title="TensorFlow">TensorFlow</a></li></ul>
<div class="mw-heading mw-heading2"><h2 id="References">References</h2></div>
<style data-mw-deduplicate="TemplateStyles:r1239543626">
/* start https://en.wikipedia.org/ */
.mw-parser-output .reflist{margin-bottom:0.5em;list-style-type:decimal}@media screen{.mw-parser-output .reflist{font-size:90%}}.mw-parser-output .reflist .references{font-size:100%;margin-bottom:0;list-style-type:inherit}.mw-parser-output .reflist-columns-2{column-width:30em}.mw-parser-output .reflist-columns-3{column-width:25em}.mw-parser-output .reflist-columns{margin-top:0.3em}.mw-parser-output .reflist-columns ol{margin-top:0}.mw-parser-output .reflist-columns li{page-break-inside:avoid;break-inside:avoid-column}.mw-parser-output .reflist-upper-alpha{list-style-type:upper-alpha}.mw-parser-output .reflist-upper-roman{list-style-type:upper-roman}.mw-parser-output .reflist-lower-alpha{list-style-type:lower-alpha}.mw-parser-output .reflist-lower-greek{list-style-type:lower-greek}.mw-parser-output .reflist-lower-roman{list-style-type:lower-roman}
/* end https://en.wikipedia.org/ */
</style><div class="reflist">
<div class="mw-references-wrap"><ol class="references">
<li id="cite_note-1"><span class="mw-cite-backlink"><b><a href="#cite_ref-1">^</a></b></span> <span class="reference-text"><style data-mw-deduplicate="TemplateStyles:r1238218222">
/* start https://en.wikipedia.org/ */
.mw-parser-output cite.citation{font-style:inherit;word-wrap:break-word}.mw-parser-output .citation q{quotes:"\"""\"""'""'"}.mw-parser-output .citation:target{background-color:rgba(0,127,255,0.133)}.mw-parser-output .id-lock-free.id-lock-free a{background:url("./mw/Lock-green.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-limited.id-lock-limited a,.mw-parser-output .id-lock-registration.id-lock-registration a{background:url("./mw/Lock-gray-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-subscription.id-lock-subscription a{background:url("./mw/Lock-red-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .cs1-ws-icon a{background:url("./mw/Wikisource-logo.svg")right 0.1em center/12px no-repeat}body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-free a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-limited a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-registration a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-subscription a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .cs1-ws-icon a{background-size:contain;padding:0 1em 0 0}.mw-parser-output .cs1-code{color:inherit;background:inherit;border:none;padding:inherit}.mw-parser-output .cs1-hidden-error{display:none;color:var(--color-error,#d33)}.mw-parser-output .cs1-visible-error{color:var(--color-error,#d33)}.mw-parser-output .cs1-maint{display:none;color:#085;margin-left:0.3em}.mw-parser-output .cs1-kern-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right{padding-right:0.2em}.mw-parser-output .citation .mw-selflink{font-weight:inherit}@media screen{.mw-parser-output .cs1-format{font-size:95%}html.skin-theme-clientpref-night .mw-parser-output .cs1-maint{color:#18911f}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .cs1-maint{color:#18911f}}
/* end https://en.wikipedia.org/ */
</style><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://uk.pcmag.com/news-analysis/127085/microsoft-updates-windows-azure-tools-with-an-eye-on-the-future">"Microsoft Updates Windows, Azure Tools with an Eye on The Future"</a>. <i>PCMag UK</i>. May 22, 2020.</cite></span>
</li>
<li id="cite_note-2"><span class="mw-cite-backlink"><b><a href="#cite_ref-2">^</a></b></span> <span class="reference-text"><cite id="CITEREFYegulalp2020" class="citation web cs1">Yegulalp, Serdar (February 10, 2020). <a rel="nofollow" class="external text" href="https://www.infoworld.com/article/3526449/microsoft-speeds-up-pytorch-with-deepspeed.html">"Microsoft speeds up PyTorch with DeepSpeed"</a>. <i>InfoWorld</i>.</cite></span>
</li>
<li id="cite_note-3"><span class="mw-cite-backlink"><b><a href="#cite_ref-3">^</a></b></span> <span class="reference-text"><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://www.neowin.net/news/microsoft-unveils-fifth-most-powerful-supercomputer-in-the-world/">"Microsoft unveils "fifth most powerful" supercomputer in the world"</a>. <i>Neowin</i>. 18 June 2023.</cite></span>
</li>
<li id="cite_note-4"><span class="mw-cite-backlink"><b><a href="#cite_ref-4">^</a></b></span> <span class="reference-text"><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://venturebeat.com/2020/02/10/microsoft-trains-worlds-largest-transformer-language-model/">"Microsoft trains world's largest Transformer language model"</a>. February 10, 2020.</cite></span>
</li>
<li id="cite_note-5"><span class="mw-cite-backlink"><b><a href="#cite_ref-5">^</a></b></span> <span class="reference-text"><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://github.com/microsoft/DeepSpeed">"microsoft/DeepSpeed"</a>. July 10, 2020 – via GitHub.</cite></span>
</li>
<li id="cite_note-:0-6"><span class="mw-cite-backlink"><b><a href="#cite_ref-:0_6-0">^</a></b></span> <span class="reference-text"><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://www.microsoft.com/en-us/research/blog/deepspeed-accelerating-large-scale-model-inference-and-training-via-system-optimizations-and-compression/">"DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression"</a>. <i>Microsoft Research</i>. 2021-05-24<span class="reference-accessdate">. Retrieved <span class="nowrap">2021-06-19</span></span>.</cite></span>
</li>
</ol></div></div>
<div class="mw-heading mw-heading2"><h2 id="Further_reading">Further reading</h2></div>
<ul><li><cite id="CITEREFRajbhandariRasleyRuwaseHe2019" class="citation arxiv cs1">Rajbhandari, Samyam; Rasley, Jeff; Ruwase, Olatunji; He, Yuxiong (2019). "ZeRO: Memory Optimization Towards Training A Trillion Parameter Models". <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/1910.02054">1910.02054</a></span> [<a rel="nofollow" class="external text" href="https://arxiv.org/archive/cs.LG">cs.LG</a>].</cite></li></ul>
<div class="mw-heading mw-heading2"><h2 id="External_links">External links</h2></div>
<ul><li><a rel="nofollow" class="external text" href="https://www.microsoft.com/en-us/research/project/ai-at-scale/">AI at Scale - Microsoft Research</a></li>
<li><a rel="nofollow" class="external text" href="https://github.com/microsoft/DeepSpeed">GitHub - microsoft/DeepSpeed</a></li>
<li><a rel="nofollow" class="external text" href="https://www.microsoft.com/en-us/research/blog/zero-deepspeed-new-system-optimizations-enable-training-models-with-over-100-billion-parameters/">ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters - Microsoft Research</a></li></ul>
<div class="navbox-styles"><style data-mw-deduplicate="TemplateStyles:r1129693374">
/* start https://en.wikipedia.org/ */
.mw-parser-output .hlist dl,.mw-parser-output .hlist ol,.mw-parser-output .hlist ul{margin:0;padding:0}.mw-parser-output .hlist dd,.mw-parser-output .hlist dt,.mw-parser-output .hlist li{margin:0;display:inline}.mw-parser-output .hlist.inline,.mw-parser-output .hlist.inline dl,.mw-parser-output .hlist.inline ol,.mw-parser-output .hlist.inline ul,.mw-parser-output .hlist dl dl,.mw-parser-output .hlist dl ol,.mw-parser-output .hlist dl ul,.mw-parser-output .hlist ol dl,.mw-parser-output .hlist ol ol,.mw-parser-output .hlist ol ul,.mw-parser-output .hlist ul dl,.mw-parser-output .hlist ul ol,.mw-parser-output .hlist ul ul{display:inline}.mw-parser-output .hlist .mw-empty-li{display:none}.mw-parser-output .hlist dt::after{content:": "}.mw-parser-output .hlist dd::after,.mw-parser-output .hlist li::after{content:" · ";font-weight:bold}.mw-parser-output .hlist dd:last-child::after,.mw-parser-output .hlist dt:last-child::after,.mw-parser-output .hlist li:last-child::after{content:none}.mw-parser-output .hlist dd dd:first-child::before,.mw-parser-output .hlist dd dt:first-child::before,.mw-parser-output .hlist dd li:first-child::before,.mw-parser-output .hlist dt dd:first-child::before,.mw-parser-output .hlist dt dt:first-child::before,.mw-parser-output .hlist dt li:first-child::before,.mw-parser-output .hlist li dd:first-child::before,.mw-parser-output .hlist li dt:first-child::before,.mw-parser-output .hlist li li:first-child::before{content:" (";font-weight:normal}.mw-parser-output .hlist dd dd:last-child::after,.mw-parser-output .hlist dd dt:last-child::after,.mw-parser-output .hlist dd li:last-child::after,.mw-parser-output .hlist dt dd:last-child::after,.mw-parser-output .hlist dt dt:last-child::after,.mw-parser-output .hlist dt li:last-child::after,.mw-parser-output .hlist li dd:last-child::after,.mw-parser-output .hlist li dt:last-child::after,.mw-parser-output .hlist li li:last-child::after{content:")";font-weight:normal}.mw-parser-output .hlist ol{counter-reset:listitem}.mw-parser-output .hlist ol>li{counter-increment:listitem}.mw-parser-output .hlist ol>li::before{content:" "counter(listitem)"\a0 "}.mw-parser-output .hlist dd ol>li:first-child::before,.mw-parser-output .hlist dt ol>li:first-child::before,.mw-parser-output .hlist li ol>li:first-child::before{content:" ("counter(listitem)"\a0 "}
/* end https://en.wikipedia.org/ */
</style><style data-mw-deduplicate="TemplateStyles:r1236075235">
/* start https://en.wikipedia.org/ */
.mw-parser-output .navbox{box-sizing:border-box;border:1px solid #a2a9b1;width:100%;clear:both;font-size:88%;text-align:center;padding:1px;margin:1em auto 0}.mw-parser-output .navbox .navbox{margin-top:0}.mw-parser-output .navbox+.navbox,.mw-parser-output .navbox+.navbox-styles+.navbox{margin-top:-1px}.mw-parser-output .navbox-inner,.mw-parser-output .navbox-subgroup{width:100%}.mw-parser-output .navbox-group,.mw-parser-output .navbox-title,.mw-parser-output .navbox-abovebelow{padding:0.25em 1em;line-height:1.5em;text-align:center}.mw-parser-output .navbox-group{white-space:nowrap;text-align:right}.mw-parser-output .navbox,.mw-parser-output .navbox-subgroup{background-color:#fdfdfd}.mw-parser-output .navbox-list{line-height:1.5em;border-color:#fdfdfd}.mw-parser-output .navbox-list-with-group{text-align:left;border-left-width:2px;border-left-style:solid}.mw-parser-output tr+tr>.navbox-abovebelow,.mw-parser-output tr+tr>.navbox-group,.mw-parser-output tr+tr>.navbox-image,.mw-parser-output tr+tr>.navbox-list{border-top:2px solid #fdfdfd}.mw-parser-output .navbox-title{background-color:#ccf}.mw-parser-output .navbox-abovebelow,.mw-parser-output .navbox-group,.mw-parser-output .navbox-subgroup .navbox-title{background-color:#ddf}.mw-parser-output .navbox-subgroup .navbox-group,.mw-parser-output .navbox-subgroup .navbox-abovebelow{background-color:#e6e6ff}.mw-parser-output .navbox-even{background-color:#f7f7f7}.mw-parser-output .navbox-odd{background-color:transparent}.mw-parser-output .navbox .hlist td dl,.mw-parser-output .navbox .hlist td ol,.mw-parser-output .navbox .hlist td ul,.mw-parser-output .navbox td.hlist dl,.mw-parser-output .navbox td.hlist ol,.mw-parser-output .navbox td.hlist ul{padding:0.125em 0}.mw-parser-output .navbox .navbar{display:block;font-size:100%}.mw-parser-output .navbox-title .navbar{float:left;text-align:left;margin-right:0.5em}body.skin--responsive .mw-parser-output .navbox-image img{max-width:none!important}@media print{body.ns-0 .mw-parser-output .navbox{display:none!important}}
/* end https://en.wikipedia.org/ */
</style></div><div role="navigation" class="navbox" aria-labelledby="Deep_learning_software304" style="padding:3px"><table class="nowraplinks hlist mw-collapsible autocollapse navbox-inner" style="border-spacing:0;background:transparent;color:inherit"><tbody><tr><th scope="col" class="navbox-title" colspan="2"><style data-mw-deduplicate="TemplateStyles:r1239400231">
/* start https://en.wikipedia.org/ */
.mw-parser-output .navbar{display:inline;font-size:88%;font-weight:normal}.mw-parser-output .navbar-collapse{float:left;text-align:left}.mw-parser-output .navbar-boxtext{word-spacing:0}.mw-parser-output .navbar ul{display:inline-block;white-space:nowrap;line-height:inherit}.mw-parser-output .navbar-brackets::before{margin-right:-0.125em;content:"[ "}.mw-parser-output .navbar-brackets::after{margin-left:-0.125em;content:" ]"}.mw-parser-output .navbar li{word-spacing:-0.125em}.mw-parser-output .navbar a>span,.mw-parser-output .navbar a>abbr{text-decoration:inherit}.mw-parser-output .navbar-mini abbr{font-variant:small-caps;border-bottom:none;text-decoration:none;cursor:inherit}.mw-parser-output .navbar-ct-full{font-size:114%;margin:0 7em}.mw-parser-output .navbar-ct-mini{font-size:114%;margin:0 4em}html.skin-theme-clientpref-night .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}@media(prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}}@media print{.mw-parser-output .navbar{display:none!important}}
/* end https://en.wikipedia.org/ */
</style><div id="Deep_learning_software304" style="font-size:114%;margin:0 4em"><a href="Comparison_of_deep_learning_software" title="Comparison of deep learning software">Deep learning software</a></div></th></tr><tr><td class="navbox-abovebelow" colspan="2"><div>
<ul><li><a href="Comparison_of_deep_learning_software" title="Comparison of deep learning software">Comparison</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Open-source_software" title="Open-source software">Open source</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Apache_MXNet" title="Apache MXNet">Apache MXNet</a></li>
<li><a href="Apache_SINGA" title="Apache SINGA">Apache SINGA</a></li>
<li><a href="Caffe_(software)" title="Caffe (software)">Caffe</a></li>
<li><a href="Deeplearning4j" title="Deeplearning4j">Deeplearning4j</a></li>
<li><a href="Dlib" title="Dlib">Dlib</a></li>
<li><a href="Keras" title="Keras">Keras</a></li>
<li><a href="Microsoft_Cognitive_Toolkit" title="Microsoft Cognitive Toolkit">Microsoft Cognitive Toolkit</a></li>
<li><a href="ML.NET" title="ML.NET">ML.NET</a></li>
<li><a href="OpenNN" title="OpenNN">OpenNN</a></li>
<li><a href="PyTorch" title="PyTorch">PyTorch</a></li>
<li><a href="TensorFlow" title="TensorFlow">TensorFlow</a></li>
<li><a href="Theano_(software)" title="Theano (software)">Theano</a></li>
<li><a href="Torch_(machine_learning)" title="Torch (machine learning)">Torch</a></li>
<li><a href="Open_Neural_Network_Exchange" title="Open Neural Network Exchange">ONNX</a></li>
<li><a href="OpenVINO" title="OpenVINO">OpenVINO</a></li>
<li><a href="MindSpore" title="MindSpore">MindSpore</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Proprietary_software" title="Proprietary software">Proprietary</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Apple_Inc." title="Apple Inc.">Apple</a> <a href="Core_ML" class="mw-redirect" title="Core ML">Core ML</a></li>
<li><a href="Watson_(computer)" class="mw-redirect" title="Watson (computer)">IBM Watson</a></li>
<li><a href="Neural_Designer" title="Neural Designer">Neural Designer</a></li>
<li><a href="Wolfram_Mathematica" class="mw-redirect" title="Wolfram Mathematica">Wolfram Mathematica</a></li>
<li><a href="MATLAB" title="MATLAB">MATLAB</a> Deep Learning Toolbox</li></ul>
</div></td></tr><tr><td class="navbox-abovebelow" colspan="2"><div>
<ul><li><span class="noviewer" typeof="mw:File"><span title="Category"></span></span> Category</li></ul>
</div></td></tr></tbody></table></div>
<div class="navbox-styles"></div><div role="navigation" class="navbox" aria-labelledby="Microsoft_free_and_open-source_software_(FOSS)290" style="padding:3px"><table class="nowraplinks mw-collapsible autocollapse navbox-inner" style="border-spacing:0;background:transparent;color:inherit"><tbody><tr><th scope="col" class="navbox-title" colspan="2"><div id="Microsoft_free_and_open-source_software_(FOSS)290" style="font-size:114%;margin:0 4em"><a href="Microsoft" title="Microsoft">Microsoft</a> <a href="Free_and_open-source_software" title="Free and open-source software">free and open-source software (FOSS)</a></div></th></tr><tr><th scope="row" class="navbox-group" style="width:1%">Overview</th><td class="navbox-list-with-group navbox-list navbox-odd hlist" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Microsoft_and_open_source" title="Microsoft and open source">Microsoft and open source</a></li>
<li><a href="Shared_Source_Initiative" title="Shared Source Initiative">Shared Source Initiative</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Software</th><td class="navbox-list-with-group navbox-list navbox-odd hlist" style="width:100%;padding:0"><div style="padding:0 0.25em"></div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th scope="row" class="navbox-group" style="width:1%">Applications</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="3D_Movie_Maker" title="3D Movie Maker">3D Movie Maker</a></li>
<li><a href="Atom_(text_editor)" title="Atom (text editor)">Atom</a></li>
<li><a href="Conference_XP" title="Conference XP">Conference XP</a></li>
<li><a href="Family.Show" title="Family.Show">Family.Show</a></li>
<li><a href="File_Manager_(Windows)" class="mw-redirect" title="File Manager (Windows)">File Manager</a></li>
<li><a href="Open_Live_Writer" title="Open Live Writer">Open Live Writer</a></li>
<li><a href="Microsoft_Edit" class="mw-redirect" title="Microsoft Edit">Microsoft Edit</a></li>
<li><a href="Microsoft_PowerToys" title="Microsoft PowerToys">Microsoft PowerToys</a></li>
<li><a href="Windows_Terminal" title="Windows Terminal">Terminal</a></li>
<li><a href="Windows_Calculator" title="Windows Calculator">Windows Calculator</a></li>
<li><a href="Windows_Console" title="Windows Console">Windows Console</a></li>
<li><a href="Windows_Package_Manager" title="Windows Package Manager">Windows Package Manager</a></li>
<li><a href="WorldWide_Telescope" title="WorldWide Telescope">WorldWide Telescope</a></li>
<li><a href="XML_Notepad" title="XML Notepad">XML Notepad</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Video games</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Allegiance_(video_game)" title="Allegiance (video game)">Allegiance</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Programming<br>languages</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Bosque_(programming_language)" title="Bosque (programming language)">Bosque</a></li>
<li><a href="C_Sharp_(programming_language)" title="C Sharp (programming language)">C#</a></li>
<li><a href="Dafny" title="Dafny">Dafny</a></li>
<li><a href="F_Sharp_(programming_language)" title="F Sharp (programming language)">F#</a></li>
<li><a href="F*_(programming_language)" title="F* (programming language)">F*</a></li>
<li><a href="GW-BASIC" title="GW-BASIC">GW-BASIC</a></li>
<li><a href="IronPython" title="IronPython">IronPython</a></li>
<li><a href="IronRuby" title="IronRuby">IronRuby</a></li>
<li><a href="Lean_(proof_assistant)" title="Lean (proof assistant)">Lean</a></li>
<li><a href="P_(programming_language)" title="P (programming language)">P</a></li>
<li><a href="Microsoft_Power_Fx" title="Microsoft Power Fx">Power Fx</a></li>
<li><a href="PowerShell" title="PowerShell">PowerShell</a></li>
<li><a href="Project_Verona" title="Project Verona">Project Verona</a></li>
<li><a href="Q_Sharp" title="Q Sharp">Q#</a></li>
<li><a href="Microsoft_Small_Basic" title="Microsoft Small Basic">Small Basic Online</a></li>
<li><a href="TypeScript" title="TypeScript">TypeScript</a></li>
<li><a href="Visual_Basic_.NET" class="mw-redirect" title="Visual Basic .NET">Visual Basic</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Frameworks,<br>development tools</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href=".NET" title=".NET">.NET</a></li>
<li><a href=".NET_Framework" title=".NET Framework">.NET Framework</a></li>
<li><a href=".NET_Gadgeteer" title=".NET Gadgeteer">.NET Gadgeteer</a></li>
<li><a href=".NET_MAUI" class="mw-redirect" title=".NET MAUI">.NET MAUI</a></li>
<li><a href=".NET_Micro_Framework" title=".NET Micro Framework">.NET Micro Framework</a></li>
<li><a href="AirSim" title="AirSim">AirSim</a></li>
<li><a href="ASP.NET" title="ASP.NET">ASP.NET</a></li>
<li><a href="ASP.NET_AJAX" title="ASP.NET AJAX">ASP.NET AJAX</a></li>
<li><a href="ASP.NET_Core" title="ASP.NET Core">ASP.NET Core</a></li>
<li><a href="ASP.NET_MVC" title="ASP.NET MVC">ASP.NET MVC</a></li>
<li><a href="ASP.NET_Razor" title="ASP.NET Razor">ASP.NET Razor</a></li>
<li><a href="ASP.NET_Web_Forms" title="ASP.NET Web Forms">ASP.NET Web Forms</a></li>
<li><a href="Avalonia_(software_framework)" title="Avalonia (software framework)">Avalonia</a></li>
<li><a href="Babylon.js" title="Babylon.js">Babylon.js</a></li>
<li><a href="BitFunnel" title="BitFunnel">BitFunnel</a></li>
<li><a href="Blazor" title="Blazor">Blazor</a></li>
<li><a href="C%2B%2B/WinRT" title="C++/WinRT">C++/WinRT</a></li>
<li><a href="Confidential_Consortium_Framework" title="Confidential Consortium Framework">CCF</a></li>
<li><a href="Chakra_(JavaScript_engine)" title="Chakra (JavaScript engine)">ChakraCore</a></li>
<li><a href="CLR_Profiler" title="CLR Profiler">CLR Profiler</a></li>
<li><a href="Dapr" title="Dapr">Dapr</a></li>
<li><a href="DiskSpd" title="DiskSpd">DiskSpd</a></li>
<li><a href="Dryad_(programming)" title="Dryad (programming)">Dryad</a></li>
<li><a href="Dynamic_Language_Runtime" title="Dynamic Language Runtime">Dynamic Language Runtime</a></li>
<li><a href="EBPF_on_Windows" class="mw-redirect" title="EBPF on Windows">eBPF on Windows</a></li>
<li><a href="Electron_(software_framework)" title="Electron (software framework)">Electron</a></li>
<li><a href="Entity_Framework" title="Entity Framework">Entity Framework</a></li>
<li><a href="Fluent_Design_System" title="Fluent Design System">Fluent Design System</a></li>
<li><a href="Fluid_Framework" title="Fluid Framework">Fluid Framework</a></li>
<li><a href="Infer.NET" title="Infer.NET">Infer.NET</a></li>
<li><a href="LightGBM" title="LightGBM">LightGBM</a></li>
<li><a href="Managed_Extensibility_Framework" title="Managed Extensibility Framework">Managed Extensibility Framework</a></li>
<li><a href="Microsoft_Automatic_Graph_Layout" title="Microsoft Automatic Graph Layout">Microsoft Automatic Graph Layout</a></li>
<li><a href="Microsoft_C%2B%2B_Standard_Library" class="mw-redirect" title="Microsoft C++ Standard Library">Microsoft C++ Standard Library</a></li>
<li><a href="Microsoft_Cognitive_Toolkit" title="Microsoft Cognitive Toolkit">Microsoft Cognitive Toolkit</a></li>
<li><a href="Metro_(design_language)" title="Metro (design language)">Microsoft Design Language</a></li>
<li><a href="Microsoft_Detours" title="Microsoft Detours">Microsoft Detours</a></li>
<li><a href="Microsoft_Enterprise_Library" title="Microsoft Enterprise Library">Microsoft Enterprise Library</a></li>
<li><a href="Microsoft_SEAL" title="Microsoft SEAL">Microsoft SEAL</a></li>
<li><a href="Mimalloc" title="Mimalloc">mimalloc</a></li>
<li><a href="Mixed_Reality_Toolkit" title="Mixed Reality Toolkit">Mixed Reality Toolkit</a></li>
<li><a href="ML.NET" title="ML.NET">ML.NET</a></li>
<li><a href="Mod_mono" title="Mod mono">mod_mono</a></li>
<li><a href="Mono_(software)" title="Mono (software)">Mono</a></li>
<li><a href="MonoDevelop" title="MonoDevelop">MonoDevelop</a></li>
<li><a href="MSBuild" title="MSBuild">MSBuild</a></li>
<li><a href="MsQuic" title="MsQuic">MsQuic</a></li>
<li><a href="Neural_Network_Intelligence" title="Neural Network Intelligence">Neural Network Intelligence</a></li>
<li><a href="Npm" title="Npm">npm</a></li>
<li><a href="NuGet" title="NuGet">NuGet</a></li>
<li><a href="OneFuzz" title="OneFuzz">OneFuzz</a></li>
<li><a href="Open_Management_Infrastructure" title="Open Management Infrastructure">Open Management Infrastructure</a></li>
<li><a href="Open_Neural_Network_Exchange" title="Open Neural Network Exchange">Open Neural Network Exchange</a></li>
<li><a href="Open_Service_Mesh" title="Open Service Mesh">Open Service Mesh</a></li>
<li><a href="Open_XML_SDK" class="mw-redirect" title="Open XML SDK">Open XML SDK</a></li>
<li><a href="Orleans_(software_framework)" title="Orleans (software framework)">Orleans</a></li>
<li><a href="Playwright_(software)" title="Playwright (software)">Playwright</a></li>
<li><a href="ProcDump" title="ProcDump">ProcDump</a></li>
<li><a href="Process_Monitor" title="Process Monitor">ProcMon</a></li>
<li><a href="Python_Tools_for_Visual_Studio" title="Python Tools for Visual Studio">Python Tools for Visual Studio</a></li>
<li><a href="R_Tools_for_Visual_Studio" title="R Tools for Visual Studio">R Tools for Visual Studio</a></li>
<li><a href="RecursiveExtractor" class="mw-redirect" title="RecursiveExtractor">RecursiveExtractor</a></li>
<li><a href="Roslyn_(compiler)" title="Roslyn (compiler)">Roslyn</a></li>
<li><a href="Sandcastle_(software)" title="Sandcastle (software)">Sandcastle</a></li>
<li><a href="SignalR" title="SignalR">SignalR</a></li>
<li><a href="StyleCop" title="StyleCop">StyleCop</a></li>
<li><a href="SVNBridge" title="SVNBridge">SVNBridge</a></li>
<li><a href="T2_Temporal_Prover" title="T2 Temporal Prover">T2 Temporal Prover</a></li>
<li><a href="Text_Template_Transformation_Toolkit" title="Text Template Transformation Toolkit">Text Template Transformation Toolkit</a></li>
<li><a href="TLA%2B_Toolbox" class="mw-redirect" title="TLA+ Toolbox">TLA+ Toolbox</a></li>
<li><a href="U-Prove" title="U-Prove">U-Prove</a></li>
<li><a href="Vcpkg" title="Vcpkg">vcpkg</a></li>
<li><a href="Virtual_File_System_for_Git" title="Virtual File System for Git">Virtual File System for Git</a></li>
<li><a href="Voldemort_(distributed_data_store)" title="Voldemort (distributed data store)">Voldemort</a></li>
<li><a href="VoTT" title="VoTT">VoTT</a></li>
<li><a href="Vowpal_Wabbit" title="Vowpal Wabbit">Vowpal Wabbit</a></li>
<li><a href="Windows_App_SDK" title="Windows App SDK">Windows App SDK</a></li>
<li><a href="Windows_Communication_Foundation" title="Windows Communication Foundation">Windows Communication Foundation</a></li>
<li><a href="Windows_Driver_Frameworks" title="Windows Driver Frameworks">Windows Driver Frameworks</a>
<ul><li><a href="Kernel-Mode_Driver_Framework" title="Kernel-Mode Driver Framework">KMDF</a></li>
<li><a href="User-Mode_Driver_Framework" title="User-Mode Driver Framework">UMDF</a></li></ul></li>
<li><a href="Windows_Forms" title="Windows Forms">Windows Forms</a></li>
<li><a href="Windows_Presentation_Foundation" title="Windows Presentation Foundation">Windows Presentation Foundation</a></li>
<li><a href="Windows_Template_Library" title="Windows Template Library">Windows Template Library</a></li>
<li><a href="Windows_UI_Library" title="Windows UI Library">Windows UI Library</a></li>
<li><a href="WinJS" title="WinJS">WinJS</a></li>
<li><a href="WinObjC" class="mw-redirect" title="WinObjC">WinObjC</a></li>
<li><a href="WiX" title="WiX">WiX</a></li>
<li><a href="XDP_for_Windows" class="mw-redirect" title="XDP for Windows">XDP for Windows</a></li>
<li><a href="XSP_(software)" title="XSP (software)">XSP</a></li>
<li><a href="XUnit.net" title="XUnit.net">xUnit.net</a></li>
<li><a href="Z3_Theorem_Prover" title="Z3 Theorem Prover">Z3 Theorem Prover</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Operating systems</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="MS-DOS" title="MS-DOS">MS-DOS</a> (v1.25, v2.0 & v4.0)</li>
<li><a href="Barrelfish_(operating_system)" title="Barrelfish (operating system)">Barrelfish</a></li>
<li><a href="SONiC_(operating_system)" title="SONiC (operating system)">SONiC</a></li>
<li><a href="Azure_Linux" title="Azure Linux">Azure Linux</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Other</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="ChronoZoom" title="ChronoZoom">ChronoZoom</a></li>
<li><a href="Extensible_Storage_Engine" title="Extensible Storage Engine">Extensible Storage Engine</a></li>
<li><a href="FlexWiki" class="mw-redirect" title="FlexWiki">FlexWiki</a></li>
<li><a href="FourQ" title="FourQ">FourQ</a></li>
<li><a href="Gollum_(software)" title="Gollum (software)">Gollum</a></li>
<li><a href="Project_Mu" class="mw-redirect" title="Project Mu">Project Mu</a></li>
<li><a href="ReactiveX" title="ReactiveX">ReactiveX</a></li>
<li><a href="SILK" title="SILK">SILK</a></li>
<li><a href="TLAPS" class="mw-redirect" title="TLAPS">TLAPS</a></li>
<li><a href="TPM_2.0_Reference_Implementation" class="mw-redirect" title="TPM 2.0 Reference Implementation">TPM 2.0 Reference Implementation</a></li>
<li><a href="WikiBhasha" title="WikiBhasha">WikiBhasha</a></li>
<li><a href="Windows_Subsystem_for_Linux" title="Windows Subsystem for Linux">Windows Subsystem for Linux</a></li></ul>
</div></td></tr></tbody></table><div></div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Open-source_license" title="Open-source license">Licenses</a></th><td class="navbox-list-with-group navbox-list navbox-even hlist" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Microsoft_Public_License" class="mw-redirect" title="Microsoft Public License">Microsoft Public License</a></li>
<li><a href="Microsoft_Reciprocal_License" class="mw-redirect" title="Microsoft Reciprocal License">Microsoft Reciprocal License</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Forge_(software)" title="Forge (software)">Forges</a></th><td class="navbox-list-with-group navbox-list navbox-odd hlist" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="CodePlex" title="CodePlex">CodePlex</a></li>
<li><a href="GitHub" title="GitHub">GitHub</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Related</th><td class="navbox-list-with-group navbox-list navbox-even hlist" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href=".NET_Foundation" title=".NET Foundation">.NET Foundation</a></li>
<li><a href="F_Sharp_Software_Foundation" title="F Sharp Software Foundation">F# Software Foundation</a></li>
<li><a href="Microsoft_Open_Specification_Promise" title="Microsoft Open Specification Promise">Microsoft Open Specification Promise</a></li>
<li><a href="Open_Letter_to_Hobbyists" class="mw-redirect" title="Open Letter to Hobbyists">Open Letter to Hobbyists</a></li>
<li><a href="Open_Source_Security_Foundation" title="Open Source Security Foundation">Open Source Security Foundation</a></li>
<li><a href="Outercurve_Foundation" title="Outercurve Foundation">Outercurve Foundation</a></li></ul>
</div></td></tr><tr><td class="navbox-abovebelow" colspan="2"><div><span class="noviewer" typeof="mw:File"><span title="Category"></span></span> Category</div></td></tr></tbody></table></div>
<div class="navbox-styles"></div><div role="navigation" class="navbox" aria-labelledby="Microsoft_Research_(MSR)216" style="padding:3px"><table class="nowraplinks mw-collapsible autocollapse navbox-inner" style="border-spacing:0;background:transparent;color:inherit"><tbody><tr><th scope="col" class="navbox-title" colspan="2"><div id="Microsoft_Research_(MSR)216" style="font-size:114%;margin:0 4em"><a href="Microsoft_Research" title="Microsoft Research">Microsoft Research (MSR)</a></div></th></tr><tr><th scope="row" class="navbox-group" style="width:1%">Main<br>projects</th><td class="navbox-list-with-group navbox-list navbox-odd hlist" style="width:100%;padding:0"><div style="padding:0 0.25em"></div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th scope="row" class="navbox-group" style="width:1%">Languages, compilers</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Bartok_(compiler)" title="Bartok (compiler)">Bartok</a></li>
<li><a href="Bosque_(programming_language)" title="Bosque (programming language)">Bosque</a></li>
<li><a href="C%CF%89" class="mw-redirect" title="Cω">Cω</a></li>
<li><a href="F*_(programming_language)" title="F* (programming language)">F*</a></li>
<li><a href="Lean_(proof_assistant)" title="Lean (proof assistant)">Lean</a></li>
<li><a href="P_(programming_language)" title="P (programming language)">P</a></li>
<li><a href="Project_Verona" title="Project Verona">Project Verona</a></li>
<li><a href="Microsoft_Phoenix" title="Microsoft Phoenix">Phoenix</a></li>
<li><a href="Polyphonic_C_Sharp" class="mw-redirect" title="Polyphonic C Sharp">Polyphonic C#</a></li>
<li><a href="SecPAL" title="SecPAL">SecPAL</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Distributed_computing" title="Distributed computing">Distributed</a>–<a href="Grid_computing" title="Grid computing">grid computing</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="BitVault" title="BitVault">BitVault</a></li>
<li><a href="Confidential_Consortium_Framework" title="Confidential Consortium Framework">Confidential Consortium Framework</a></li>
<li><a href="Orleans_(software_framework)" title="Orleans (software framework)">Orleans</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Internet" title="Internet">Internet</a>, <a href="Computer_network" title="Computer network">networking</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li>AjaxView</li>
<li><a href="Avalanche_(P2P)" title="Avalanche (P2P)">Avalanche</a></li>
<li><a href="Conference_XP" title="Conference XP">Conference XP</a></li>
<li><a href="Gazelle_(web_browser)" title="Gazelle (web browser)">Gazelle</a></li>
<li><a href="HoneyMonkey" title="HoneyMonkey">HoneyMonkey</a></li>
<li><a href="Penny_Black_(research_project)" title="Penny Black (research project)">Penny Black</a></li>
<li><a href="Wallop" title="Wallop">Wallop</a></li>
<li><a href="WikiBhasha" title="WikiBhasha">WikiBhasha</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Other projects</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Microsoft_Automatic_Graph_Layout" title="Microsoft Automatic Graph Layout">Automatic Graph Layout</a></li>
<li><a href="Microsoft_Cognitive_Toolkit" title="Microsoft Cognitive Toolkit">Cognitive Toolkit</a></li>
<li><a href="Project_Digits" title="Project Digits">Digits</a></li>
<li><a href="Microsoft_Holoportation" title="Microsoft Holoportation">Holoportation</a></li>
<li><a href="IllumiRoom" title="IllumiRoom">IllumiRoom</a></li>
<li><a href="Image_Composite_Editor" title="Image Composite Editor">Image Composite Editor</a></li>
<li><a href="Infer.NET" title="Infer.NET">Infer.NET</a></li>
<li><a href="LightGBM" title="LightGBM">LightGBM</a></li>
<li><a href="LiveStation" title="LiveStation">LiveStation</a></li>
<li><a href="MyLifeBits" title="MyLifeBits">MyLifeBits</a></li>
<li><a href="Neural_Network_Intelligence" title="Neural Network Intelligence">Neural Network Intelligence</a></li>
<li><a href="NodeXL" title="NodeXL">NodeXL</a></li>
<li><a href="OneFuzz" title="OneFuzz">OneFuzz</a></li>
<li><a href="PhotoDNA" title="PhotoDNA">PhotoDNA</a></li>
<li><a href="Microsoft_SEAL" title="Microsoft SEAL">SEAL</a></li>
<li><a href="SLAM_project" title="SLAM project">SLAM</a></li>
<li><a href="T2_Temporal_Prover" title="T2 Temporal Prover">T2 Temporal Prover</a></li>
<li><a href="WorldWide_Telescope" title="WorldWide Telescope">WorldWide Telescope</a></li>
<li><a href="Z3_Theorem_Prover" title="Z3 Theorem Prover">Z3 Theorem Prover</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Operating_system" title="Operating system">Operating systems</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Barrelfish_(operating_system)" title="Barrelfish (operating system)">Barrelfish</a></li>
<li><a href="HomeOS" title="HomeOS">HomeOS</a></li>
<li><a href="Midori_(operating_system)" title="Midori (operating system)">Midori</a></li>
<li><a href="Singularity_(operating_system)" title="Singularity (operating system)">Singularity</a></li>
<li><a href="Verve_(operating_system)" title="Verve (operating system)">Verve</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="API" title="API">APIs</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Accelerator_(library)" title="Accelerator (library)">Accelerator</a></li>
<li><a href="Dryad_(programming)" title="Dryad (programming)">Dryad</a></li>
<li><a href="Joins_(concurrency_library)" title="Joins (concurrency library)">Joins</a></li>
<li><a href="Mimalloc" title="Mimalloc">mimalloc</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Launched as products</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="C_Sharp_(programming_language)" title="C Sharp (programming language)">C#</a></li>
<li><a href="Microsoft_Comic_Chat" title="Microsoft Comic Chat">Comic Chat</a></li>
<li><a href="Microsoft_Detours" title="Microsoft Detours">Detours</a></li>
<li><a href="F_Sharp_(programming_language)" title="F Sharp (programming language)">F#</a></li>
<li><a href="Windows_Desktop_Gadgets" title="Windows Desktop Gadgets">Sideshow</a></li>
<li><a href="Microsoft_PixelSense" title="Microsoft PixelSense">PixelSense</a> (<a href="TouchLight" title="TouchLight">TouchLight</a>)</li>
<li><a href="Microsoft_SenseCam" title="Microsoft SenseCam">SenseCam</a></li>
<li><a href="ClearType" title="ClearType">ClearType</a></li>
<li><a href="Group_Shot" class="mw-redirect" title="Group Shot">Group Shot</a></li>
<li><a href="Allegiance_(video_game)" title="Allegiance (video game)">Allegiance</a></li>
<li><a href="TrueSkill" title="TrueSkill">TrueSkill</a></li>
<li><a href="Microsoft_Songsmith" class="mw-redirect" title="Microsoft Songsmith">Songsmith</a></li>
<li><a href="Xbox" title="Xbox">Xbox</a>
<ul><li><a href="Kinect" title="Kinect">Kinect</a></li></ul></li></ul>
</div></td></tr></tbody></table><div></div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">MSR Labs<br>applied<br>research</th><td class="navbox-list-with-group navbox-list navbox-odd hlist" style="width:100%;padding:0"><div style="padding:0 0.25em"></div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Microsoft_Live_Labs" title="Microsoft Live Labs">Live Labs</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em"></div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th scope="row" class="navbox-group" style="width:1%">Current</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Microsoft_Live_Labs_Pivot" title="Microsoft Live Labs Pivot">Pivot</a></li>
<li><a href="Seadragon_Software" title="Seadragon Software">Seadragon</a>
<ul><li><a href="Deep_Zoom" title="Deep Zoom">Deep Zoom</a></li></ul></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Discontinued</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Microsoft_Live_Labs_Deepfish" title="Microsoft Live Labs Deepfish">Deepfish</a></li>
<li><a href="Microsoft_Live_Labs_Listas" title="Microsoft Live Labs Listas">Listas</a></li>
<li><a href="Live_Clipboard" title="Live Clipboard">Live Clipboard</a></li>
<li><a href="Photosynth" title="Photosynth">Photosynth</a></li></ul>
</div></td></tr></tbody></table><div></div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Microsoft_FUSE_Labs" title="Microsoft FUSE Labs">FUSE Labs</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Docs.com" title="Docs.com">Docs.com</a></li>
<li><a href="Kodu_Game_Lab" title="Kodu Game Lab">Kodu</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Other labs</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="Microsoft_Academic_Search" title="Microsoft Academic Search">Academic Search</a></li>
<li><a href="Microsoft_adCenter_Labs" title="Microsoft adCenter Labs">adCenter Labs</a></li>
<li><a href="Microsoft_Office" title="Microsoft Office">Office Labs</a></li></ul>
</div></td></tr></tbody></table><div></div></td></tr><tr><td class="navbox-abovebelow" colspan="2"><div><span class="noviewer" typeof="mw:File"><span title="Category"></span></span> Category</div></td></tr></tbody></table></div></div><!--htdig_noindex--><div><div class="zim-footer">
This article is issued from <a class="external text" title="Last edited on 2025-03-29" href="https://en.wikipedia.org/wiki/?title=DeepSpeed&oldid=1282959615">Wikipedia</a>. The text is available under <a class="external text" href="https://creativecommons.org/licenses/by-sa/4.0/deed.en">Creative Commons Attribution-Share Alike 4.0</a> unless otherwise noted. Additional terms may apply for the media files.
</div>
</div><!--/htdig_noindex--></div>
</div>
</main>
</div>
</div>
</div>
</body></html>